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ABSTRACT 

Intended primarily for teachers and administrators, 
this paper presents 20 guidelines as the basis for an evaluation 
procedure for workbook, skillbook, and ditto master components of 
basal reading programs. The paper begin;": with a discussion of how and 
why v*orkbooks are used in the classroom, a description of the 
original study from which the guidelines were developed, the 
guidelines and examples, and recommendations to teachers, publishers, 
and researchers. The guidelines include the following: (1) workbooks 
should reflect the most important aspects of what is being taught in 
the program; (2) workbooks should contain, in a form that is readily 
accessible to students and teachers, extra tasks for students who 
need extra practice; (3) the vocabulary level of the workbook tasks 
should be related to that of the rest o£ the program and to the 
students using the program; (4) the instructions should be clear, 
unambiguous, and easy to follow; (5) the layout of pages should 
combine attractiveness with utility; (6) at least some of the 
workbook tasks should be fun and have an obvious payoff to them; (7) 
most student response modes should be consistent from task to task. 
And should be as close as possible to reading or writing; (8) the art 
that appears on workbook pages must be consistent with the prose of 
the task; and (9) when appropriate, workbook tasks should be 
accompanied by brief explanations of purpose for both teachers and 
students. (HTH) 
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Evaluating Workbooks 



Abstract 

Twenty guidelines specified In an earlier paper on workbooks 
written for workbook developers (Osborn, 1982) are used as the 
basis for an evaluation procedure that can be used by teachers 
and administrators evaluating the workbook^ sklllbook, and ditto 
master components of basal reading programs* This paper Includes 
a short review of how workbooks are used In classrooms, for what 
purposes, a short discussion of the original study, and finally 
recommendations to the publishers, teachers aiid researchers* , 
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Evaluating Workbooks ^ 

The focus of this paper Is on the workbooks that are a much 
used component of most basal reading programs* Twenty guidelines 
specified In an earlier paper on workbooks written for workbook 
developers (Osborn, 1982) are used as the basis for an evaluation 
procedure that can be used by teachers and administrators 
evaluating the workbook^ sklllbook, and ditto master components 
of basal reading programs. This paper also Includes a short 
review of how workbooks are used In classrooms , for what 
purposes y a short discussion of the original study, and finally 
recommendations to the publishers who create workbooks, the 
teachers who use workbooks, and the researchers who (should) 
consider their value and thdlr design. 

The use of workbooks * My ^nterest in workbooks derived from 
a classroom study that documented how student time was spent 
during reading periods (Mason & Osborn, 1981) • For this study, 
each of 45 classrooms, grades one through six, was observed for 
two complete reading periods* The observations were made In 
classrooms that used basal reading programs* That the workbooks 
(and sklllbooks and ditto masters) that accompanied the basal 
programs were used regularly in these classrooms was evident from 
examining the data obtained by the classroom observers, and from 
analyzing interviews with the teachers* Furthermore, the 
observations revealed that, in most of the classrooms, the 
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students spent as much or more time working Independently In 
their workbooks as they did working with their teachers. 

We also found that teachers used workbooks Independently of 
how their cXassrooma were organized. Two types of classroom 
organizations (sel.':*-contalned and cross*"class groupings) were 
observed* Workbooks were used for about the same amount of time 
In each type of classroom organization. Ii) a self-contained 
classroom, workbooks have an obvious management function. But 
what fascinated me was that, In cross-'class grouped classrooms 
where teachers have to deal only with one group of students, work 
In workbooks was a regular feature of the reading lesson. It was 
evident that these teachers organized their reading periods to 
Include student time In workbooks, even when there was not a 
management need to do so. We thus concluded that the teachers we 
worked with regarded workbooks as an Important element of a 
reading program, and not as mere time fillers. 

The purpose of workbooks . The evidence from this classrooiL 
study Is that teachers use workbook type materials a great deal. 
Several obvious explanations can be forwarded to explain their 
widespread us€?9 Teachers want to provide their students with 
. practice on what is being taught, with review of what has already 
been taught,*^^'and with an integration of what has been taught into 
what l£ being taught. 

(a) Workbooks provide the teacher with what is often the 
only clear and uncompromised information about what each student 
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can do. Typically , a teacher working with a group of students 
will ask. one student to read a passage or answer a question* The 
teacher mu9t assume .that the students who are not reading or 
responding ace able to read thj^ passage and answer the questions* 
In contrast 9 workbook activities require students to do a 
protracted amount \o£ work independently* Student performance on 
workbook tasks can provide teachers with extended Information 
about the work of each of their students* 

(b) Workbook activities train studc^nts to work 
independently* In most classrooms, students do their workbaok 
tasks independently.. It is likely that several' years of this 
kind of activity helps train students to work on their own* 

'x 

(What is Important, of course, l8\that the work provided In the 
workbooks is possible to do independently , Is worth spending time 
on, and leads up to the task demands of the kind of work that the 
students will face In junior high and high school*) 
An Examination of Workbooks 

The amount of time I saw students engaged in workbook 
activities inspired me to look at some of the workbooks that 
accompany basal reading programs* I was interested in getting a 
sense of how what is taught in a basal reading program appears in 
its workbook components* Since workbooks are supposed to be part 
of a delivery system , how well they support the rest of the 
system should be evaluated* 
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As I examined workbooks, I asked myself questions about 
sufficiency , efficiency , and effectiveness • Were there a 
sufficient number of activities to give students practice with 
new learning? Were the activities efficient — In that they were 
well conceived, well^rlt .en, and correlated with the teacher 
Instruction prescribed In the teacher's guide and the text 
provided In the reader? Most Importantly , were the actlvltleo 
effective? That Is, were they capable of making a positive 
djLfference 'to the students' reading performance? I realized a 
definitive answer to this last question could be given only after 
serious and long term classroom studies. I decided, however, 
that^^untlX such studies are done, the effectiveness of workbooks 
would have to be judged on the basis of such criteria as 
sufficiency and efficiency. It also became apparent that, since 
there Is almost nothing In the educational literature about 
either the sufficiency, efficiency, or effectiveness of workbook 
activities, workbook examiners would have to evaluate workbooks 
from the vantage points of their own experiences, some educated 
guesses, and a belief In the notion that the meaningful practice 
of what Is being learned makes a difference* 

When I began, I determined to combine my classroom 
experience with the experience of analyzing the v/orkbooks that 
were plied on my desk. My professional life has Included working 
as a reading supervisor with teachers and students. I have spent 
a lot of time looking over students* shoulders as they worked in 
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workbooks, and even move time analyzing the workbook pages of 
students who had completed their assignments. When I worked In 
classrooms, my special concern was for the students for whom 
learning to read Is difficult* Such students were also my 
concern as I looked through the workbook^ on my desk. Relevant 
and challenging workbooks are probably Important to most 
students, but they may be critically Important to those students 
for whom learning to read Is difficult. These students probably 
do more workbook tasks than other students because workbooks ( and 
supplementary workbooks and additional dltt^ masters) are what 



teachers turn to when looking for additional practice materials 
for students having trouble. 



keeping In mind the criteria of sufficiency and efficiency. Au I 
examined a workbook, I would follow along In the teacher's guide, 
and the text, to see what was going on In the rest of the lesson. 
What I saw (and did not see) prompted me to put together a 
chapter that contained a set of 20 guidelines for publishers to 
consider as they developed workbook materials. Most of the 
guidelines were illustrated by "counter-examples." The "counter- 
examples" were taken from different workbooks to demonstrate what 
can go wrong with the design of workbook tasks (Osborn, 1983). 
In this paper, the 20 guidelines are put forth to be considered 
by workbook evaluators — teachers using workbooks with their 




The procedures I used were simple. I analyzed tSsks, 
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students y and adoption committees examining the workbook 
components of basal reading programs* 

Some Guidelines for Evaluating Workbook Tasks 
1« A sufficient proportion of workbook tasks should be 
relevant to that Instruction that Is^ going on In the rest of the 
unit or lesson* 

A procedure Is needed for analyzing the content ^of workbooks 
and determining their relationship to the rest of the lesson and 
to previous lessons* Table 1 can be used to record and compare 
the teaching events described In the teacher's guide and the 
types of tasks that appear In the accompanying workbooks. 



Insert Table 1 about here. 



The table has been filled In to permit a rough comparison of 
the content of a teacher's guide and the types of tasks that 
appear In the accompanying workbooks. , The vocabulary 
comprehension, decuUlng, study skills, and optional activities 
Included in the teacher's guide are matched with the workbook 
tasks in each book. A more complete filling In of the table 
would Include listing the words of the word recognition and 
vocabulary activities in the teacher's guide and the words the 
students use in the workbook tasks. Such a listing is useful in 
determining the amount of vocabulary practice and review in 
workbook tasks. 
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2. Another portion of workbook tasks should provide for a 
systeaatlc and cumulative review of what has already been taught. 

The Intent of this guide^ne Is not only to ascertain how 
the workbook pages relate to what Is being taught In a given 
lesson, but to document how much review activity is provided for 
students. Completing tables for at ,least three consecutive 
lessons (or units) will give evaluators a sense of how much 
review Is available In the workbooks * • 

Q 

3« Workbooks should reflect the most important (and 
w>rkbook appropriate), aspects of what is being taught in the 

program. / / 

» 

The completed tables for three consecutive lessons and the 
experience of. the teachers evaluating the workbooks are pro;>ably 
the best means of determining Importance and appropriateness* 
For example, if the teacher's guide. directs the teacher to teach 
about the sequencing of ideas, yet the workbook tasks associate4 
with that lesson (or the next lesson) do not provide practice on 
sequencing tasks, evaluators may judge that "importance" might be 
a problem with the workbooks of this basal program* Additional 
checks of the relationships betwen topics covered in the 
teachers' guides and workbooks in other lessons should follow* 
It is important to remember, however , that not all Instruction is 
"workbook appropriate*" If listening to the sound patterns la 
poems is part of the teacher-directed lesson, the decision not to 
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include a written i)ractice task for such auditory activity Is 
probably appropriate » 

4« Workbooks should contain » In a form that is readily 
accessible to students and teachers , extra tasks for students who 
need extra practice # 

Most basal programs provide supplementary workbook materials 
created for students who need extra practice* These tasks should 
be especially valuable tasks , and riot just more of the same 
(unless the same is evaluated as valuable)-- >ot worse yet ^' busy 
work activities witl;^ minimal instructional value* Compare, for 
example, a syllabication t^sk that requires students to color, 
cut out, and paste words into shapes, with one that has children 
marki>ng the syllables iii words — perhaps following models that 
Illustrate different syllabication generalizations # The cutting, 
pasting, and coloring task might keep children busy for a long 
time, but is unlikely to give them much practice in dividing 
words into syllabled. 

Table 2 appears below. The table can be used to tally the 
number of tasks for different topics and the number and 
appropriateness of the ta^ks. The table is filled out for four 
topics found in a second-grade workbook. (The extra help tasks 
appear in a second, supplementary workbook.) 



Insert Table 2 about here. 
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This part of the table shows that In this' workbook of this 
series, extra help tasks are available , and that the workbook 
evaluator has Judged about half of the tasks as appropriate, 

5« The vocabulary level of workbook tasks should relate to 
that of the rest of the program and to the students using the 
program. 

A completed table, similar to that described in guideline 1, 
can display the vocabulary presented in the teacher-directed part 
of the lesson, and the vocabulary requirements of the workbook 
tasks* By comparing the two lists, evaluators can identify 
programs €hat include a lot of vocabulary in workbooks not taught 
in the rest of the program* For example, if a workbook task 
directs students to underline words in passages that show 
ffee^ipgs of hostility , mystery , hilarity, and bewilderment , and 
these concepts do not appear in any vocabulary taught prior to 
the appearance of that task (nor in any of the stories the 
students read) , the evaluators should be alert to further 
instances of the lack of relationship between the components of 
the program* 

6m The instructional langua'g^ used in workbook tasks must 
be consistent; with that used in the rest of the lesson and in the 
rest of the workbook* 

That the instructions or explanations that appear In the 
teacher's manual should be consistent with the instruction used 
in practice materials seems obvious* To evaluate workbook tasks 
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for consistency with the rest of the program, compare the 
Instructions given the teacher to explain new skills and concepts 
with those given the stiidents In the workbook tasks* If, for 
example, the teacher's manual directs the teacher to describe the 
differences between fact and fiction > but the students must 
decide If paragraphs they read In their workbooks are real or not 
real > there Is an Inconsistency between components of the 
program. Inconsistency can also be found from task to task 
within a workbook, or even within a single workbook task* 

7« Instructions should be clear, unambiguous, and easy to 
follow; brevity Is a virtue. 

If workbook evaluators are experienced teachers, they know 
very well that many students do not read Instructions, but simply 
go ahead and do the task&« When easy*- to- teach students decide 
they must read Instructions, they are usually able to follow 
them^ even If the Instructions are confusing, ambiguous, or 
unclear* In contrast, when hard-to-teach students are confronted 
by unclear Instructions, their Inability to follow them only 
confounds their tenuous ability to perform the tasks* It is for 
these students that, clear .Instructions are especially important* 

Probably the best way to evaluate instructions is for the 
workbook evaluators to read a group of instructions on 
consecutive pages of workbooks* While reading, they should watch 
f ors 
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(a) Excessive wordiness — for example, "Use the words letters 
stand for and the sense of the other words to find out what the 
new word In heavy black print Is*" 

(b; Amblgulty—for example, sometimes "Jjoxes" that exist In 
Instructions are not evident on the page; unclear uses of such 
words as "first," "second," "last," "over," "under," "before," 
and "after" are common. 

« 

(c) Embedded steps — for example, "Read the first sentence*, 
and fill In the missing word. Read the second sentence. Find 
the word from the first sentence that makes sense In the second 
sentence and print It where It belongs. Then do what the last 
sentence says. Repeat for all the other sentences." 

(d) Lost steps — for example, "Fill In the blanks at the 
bottom of the page" (This Instruction appears at the top of a 
page and is the last of several different instructions. The 
students are likely to forget it by the time they get to the 
bottom of the page. 

(e) Confusion — there are directions that adults have trouble 
figuring out; for example, "Four things are named in each row. 
Three of the things named are part of the other thing. Put a 
ring around the thing that the others are part of in each row." 

(f) Extended complexity — instructions should become less 
complex as students do repeated examples of the same type of 
task. In many workbooks, complex instructions are continually 
repeated in the same form. As students become acquainted with 
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cask forms ) surely the complexity of the Instructions can be 
reduced. For example , an Initial Instruction for a workbook task 
could read: *'Read the sentence and the words below It. Decide 
which word will best complete the sentence. Write that word on 
the line." Subsequent appearances could have a much shorter 
Instruction: "Complete each sentence." 

(g) Negation-- Instructions that require students to process 
words Indicating negation are more difficult than those written 
without such words. For example, "Circle the word In each row 
that has a short vowel sound" Is easier to process than "Circle 
the word In each row that does not have a long vowel sound." 

(h) Sufficient Information— some Instructions are not 
sufficient. For example » an Instruction that asks students to 
underline the word with the same sound as the t-^ord that names the 
picture does not contain sufficient information. (The words 
represented by the pictures each contain several sounds.) 

8* The layout of pages &^hould combine attractiveness with 
utility. 

> Evaluators should watch out for workbook pages that look 
cluttered ) busy, and disorganized and for long lines of type that 
are difficult to read. Design layouts should help students 
understand the requirements of the task* Foe. example, the 
performance requirements of this task (Example A) may be obscure 
to some students, whereas in Example B each part of the task Is 
labeled and the requirements of the task are more evident. 
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Example A 

Draw a line between the syllables of each word. Then write 
the number of the rule you used. 

!• between double consonant letters 

2. between unlike consonant letters 

3. between a viowel letter and a consonant 

4. between two vowel letters 

i 

scaling duty ' letter 

battle potato person ____ 

butter explain jelly 



Examp.le B 

Draw a line between the syllables of each word* Then write 
the number of the rule you used* 

Rules 

]* between double consonant letters 

2. between unlike consonant letters 

3. between a vow^l letter and a consonant- 

4. between two vowel letters 

Rule Rule Rule 

Words Number Words Number Words Number 



scaling 






duty 






letter 


battle 






potato 






parson 


butter 






explain 






jelly 















\ 9« Workbook tasks should contain enough content so that 
there is a chance that a student doing the task will learn 
soWthing and not simply be exposed to something* 

\ 

**Enrichment" tasks that contain difficult (and often 
Impo^ant) concepts frequently appear only once* For example » 
tasks that require students to make analogies may be worthwhile » 
but unless the tasks appear within a well-planned sequence of 
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activities » those students who would most profit from practice 
with such an Important language concepts are not likely to 
benefit* A workbook with a large number of exposure" tasks Is 
probably a poor risk for hard- to- teach students. 

10. Tasks that require students to make discriminations 
must be preceded by a sufficient number of tasks that provide 
practice on the components of the discrimination. 

When students have practiced and mastered component tasks , 
they have a better chance of coping successfully with tasks that 
require them to apply what they have learned to complex tasks. 
For example y If a task requires students to Identify metaphors 
and slmlllesy evaluators should check that the task has been 
preceded by exercises In which students work separately with each 
of these figurative language forms. The opportunity to practice 
component tasks Is especially Important for hard-to-teach 
students. 

11 • The content of workbook tasks must be accurate and 
precise; workbook tasks must not present wrong information nor 
perpetuate misrules. 

Phonics y word analysis , and comprehension tasks should be 
looked at with a critical eye to make sure that students do not 
practice, for example, that "the sound of £ in hope is short," or 
that "the main idea is the first sentence of a paragraph." A 
workbook with more than one or two such tasks should be viewed 
with caution, and perhaps with alarm. 
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12 • At least some workbook tasks should be fun and have an 
obvious payoff to theu. 

Workbook evaluators should not expect all tasks to be fun 
and games 9 but occasional puzzles , word games , cartoons , and 
other gamelike tasks are probably appreciated by students* 

Caution: watch for worthwhile tasks that are fun/ not 
pointless tasks that are fun. 

13 • Most student response modes should be consistent from 
task to task* 

For example y the generalized use of the mark x may cause 
errors* Students are likely to be confused , for example , if in 
one task they are directed to use x to mark words a group of 
sentences do not need, and in the very next task to use x to mark 
the sentences that indicate the correct details from a story* 

14« Student response modes should be the closest possible 
to reading or writing* 

Except for workbooks designed for children who have not as 
yet developed writing skill , student response modes that call for 
more writing rather than less writing seem desirable* For 
example y tasks that require students to copy in letters that 
stand for words (Example C) probably teach less about word 
meaning than tasks that require students to write in words* 
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Example C 

Write the letter for the word that belongs In each blank. 

a* jumprope 
b* stars 
c. pouring 

1. Where did you leave your ? 

2. The rain was from the sky. 

3. Marcy got seven on her papers* 

Surely » the student checking over the sentence » *'Where did 
you leave your a?" will not be encouraged to check the next 
sentence* 

A similar task, but cast in a format closer to the realities 
of reading and writing is Example D: 

Example D 

Write the word that belongs in each blank* 

Jumprope 

stars 

pouring 

1* Where did you leave your ? 

2* The rain was from the sky* 

3* Marcy got seven on her papers* 

Another example of response modes is drawn from main idea 
and sequencing tasks* If there is a purpose for main idea and 
sequencing practice tasks » it is to help children identify what 
is Important in what they read* Underlining the main idea 
sentence in a paragraph (if one exists) is more like real life 
studying than finding the appropriate main idea sentence from 
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three sentences In a multiple choice Item* But requiring 
students to write out main Ideas (whether they be stated or 
implied In a paragraph) Is definitely closer to the challenges of 
real life reading and studying. By the same token, asking 
students to wi^lte out the sequence of Ideas In a paragraph 
(Example E) seems much better preparation for reading and 
studying than having them write numbers next to an array of 
phrases or sentences (Example F)« 



Read the paragraph* 

Rochelle liked to Ice skate* On Saturday mornings she 
went Ice skating, but only after she got her jobs and 
practicing done. Last Saturday Rochelle woke up early. She 
ate breakfast and then began work. She made her bed. She 
cleaned her room. Then she helped her mother sort the 
laundry. She helped her mother carry the laundry baskets to 
their car. After her mother drove away, Rochelle washed the 
dishes that were In the kitchen sink. Then she took her 
flute out of Its case and started to practice. She had been 
practicing for more than an hour when her mother came home 
from the laundromat and said, "Rochelle, lt*s time for us to 
go Ice skating In the park.** 



Example E 

Rochelle did five jobs before she and her mother weut 
skating. List those jobs In the order she did them. 

1. 



2. 



3. 



4. 



5. 
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Example F 

Number the sentences to show the order of events In the 
paragraph. 

Rochelle practiced the flute* 

Rochelle made her bed« 

Rochelle sorted the laundry. 

Rochelle did the dishes. 

Rochelle carried the laundry baskets to the car. 

Example E requires the student to write more (and the 
teacher to spend more time .correcting) than Example F, but it 
does seem more like a real life study task. 

15. The instructional design of individual tasks and of 
task sequences should be carefully planned. 

A well-designed task makes the performance requirements of 
the task clear > causes the student to attend to the important 
elements of the task, and permits the student to move without 
hazard through the task from beginning to end. So little has 
been written on the task design of workbooks that it is difficult 
to provide workbook evaluators with precise guidelines, but a few 
illustrations will provide some aspects of instructional design 
to consider, 

(a) This item purports to give students practice reading 
sentences that use two different meanings for the same word* The 
students are told to put a circle around the sentence that goes 
with the picture. 
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Example 6 
— Flowers grow in the earth. 
~ The earth moves around the sun* 

< 

The students have to read only as far as flowers In the 
first sentence to get the correct answer* The task is written so 
that no further reading is necessary ^ which means there is not a 
high probability the students will practice reading the target 
words* 

A similar item, but written so that students are much more 
likely to read each of the target words is the following; 

Example H 
— Her dog sleeps in that shed* 
— I wish her dog didn't shed* 

(b) Two part tasks in which the success of working Part 2 
depends upon the student getting all of the Items correct In Part 
If are neither instructionally sound, nor fair to students* 

(c) Some tasks are written so that student responses do not 
indicate to the teacher what the students know* For example , 
responses to this kind of syllabication task Indicate only if the 
students know how many syllables are in words, but not where the 
divisions occur (Example I)* 
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Example I 

Read each word. Color the number of clrcleB to tell how many 
syllables there are In each word. ' . ^ 

outside oooo everyone oooo vegetables oooo 

Tuesday oooo point oooo Saturday oooo 

potato oooo stopped oooo morse oooo 

(It can also be noted that taking the time to color the circles 
carefully is probably a big waste of time.) 

(d) Some tasks are written so that student responses do not 
indicate whether or not they are correct. In the following, 
example 9 the teacher has no way of telling if the student has 
identified the ^before ''events or after events; the lines the 
students draw only indicate that two obviously connected events 
have been matched. 

Example J 

Draw lines from the sentences that show before to those that 
show after . 

The girl fell on the sidewalk. Mail fell in the mailbox. 

The mailbox was full. The girl hurt! her arm. 

The water spilled from the bucket. The man filled che bucket. 

(e) Some tasks mkke unreasonable demands upon students. The 
task below would be difficult (and tedious and boring) for even 
the most compulsive adult to complete, and is probably 
frustrating and self-defeating for most second-grade students. 
(Such tasks usually present many sentences for the students to 
analyze. ) 
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Example K 

Read each sentence* Decide which consonant letter Is used 
the most. Underline It each time. ^ 

!• My most important toy is a toy train* 

2. Nancy, who lives in the next house , has nine cats* 

3. Will you bring your box of marbles to the party? 

Another example of unreasonableness follows: 

Example L 

In these sentences some words end with these blends: If, Ip, 
It, nd, nt, cut, ft, mp« Underline the letters for these blends 
in the words In these sentences • 

1. The cat and dog are sitting on a shelf* ^ 

2. We will plant a tree in the camp* 

3« The snow an^ice will slowly melt* ' ^ 

(A question that often comes up after a given task is 
labeled "unreasonable" is "What good is this task anyway?" Such . 
questions should be honored and truthfully answered by workbook 
evaluators*) 

16« Workbooks should contain a finite number of task types 
and forms* 

The repetition of task forms is not a common practice in 
workbooks* On the contrary, there are usually almost as many 
task forms as there are pages in a workbook* The frequent us^ of 
the same task forms, but with differing content has two 
advantages: it reduces the need for teacher help, and once 
students have learned to work a task form, students can 
concentrate on task content* 
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One procedure for charting the task forms In a workbook Is 

t V: 

as follows: v> 



a* Select' 30 consecutive pages from a w<]irkbook« 

b« Write down a topic f^r each page, for example , '^practice 

'I • , 

•with words with sw-,"^ or ^'alphabetical order." 

c« Mark any task that has another task in the same form* 



Insert Table 3 about here* 



Tibbie 3 represents thirty consecutive pages in a third-grade 
workbook* Th^ labels in squares , circles, and wave circles mark 
the number of times task forms are repeated* That only three 
'fortbs were repeated one time each may not see^ a lot — but even 
such minimal repetition of forms is more than occurs in many 
workbooks* Note that not all similar task labels imply a similar 
task form* 

Since counting task fof'ms also involves counting task 
topics , the other benefit of this kind of evaluation is the 
revelation of the number of topics covered in a workbook* 
Sometimes there are as many different task forms and. topics as 
there are pages in the workbook* The variety of topic and the 
lack of repetition of either topic or task form may lead the 
workbook evaluators to wonder about the sufficiency of practice 
available to students: Do workbooks contain a sufficient number 
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of tasks to provide the massed practice that might help hard- to- 
teach students master the skills and concepts of the program? 

17* The art that appears on workbook pages must be ^ 
consistent with the prose of the task* 

Pictures that are confusing and Inappropriate to the task 
are bad — no matter how nice they may look* Inappropriate and 
confusing art can turn a task Into a guessing game* Sometimes 
pictures are extraneous to the content of a workbook page and 
seem to exist solely as a decorative effort— and as occupiers of 
space that could perhaps be more profitably used. 

' Workbook evaluators can sample the appropriateness of arp by 
follov^lng this procedure: 

a. Randomly select 20 Illustrated pages from a workbook. 

b« Examine each page according to the following criteria: 

- Clarity of drawings (Does the picture illustrate what 
it is supposed to?) 

- Relationship of picture to items (Do the pictures 
relate to the text?) 

- Appropriateness (Are the picturea necessary? Is their 
presence a help or a hindrance to completing the task? 

Particular attention should be given to an examination of 
the sound analysis tasks that frequently appear in beginning 
levels of a program. Example M represents a hazardous task* 
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Example M 

Circle the pictures whose names begin with the beginning 
sound of the word cat . . . 

(pictures) Ice cube car crown cap 

The Ice cube could be Identified as beginning with the same 
sound as the word Ice , the car Identified as an automobile, the 
cap as a hat and the crown as a king. None of these perfectly 
reasonable Identifications would do much for the score of the 
student who was thinking of them. Teachers should be aware that 

« 

such t^sks need a lot of teacher direction to have a chance of , 
achieving their intent. 

18ft Cute, nonfunctional y and space-and-*tiiae consuming tasks 
should be avoided • 

While one person's "fun'* task may be another's "non- 
functional*' task, workbooks with large numbers of non-functional 
and space-eating tasks should make teachers uneasy. The 
proportion of nonfunctional tasks in a workbook can be calculated 
by counting. Even though the success of this effort will depend 
upon the agreement (or near agreement) of the people evaluating 
the workbooks, such an effort is worth pursuing. If more than 5% 
of workbook tasks are judged non-functlonai, the practice 
function of that workbook would have to be questioned, especially 
for hard* to- teach students. 
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19* When appropriate^ workbook tasks should be accompanied 
by brief explanations of purpose for both teachers and students. 

Explanations about the purpose of the tasks should ^e 
available to the teacher and when headings to e> \ ' n purpose are 
written for students, the purpose should be In language the 
students are likely to understand. 

The following task titles selected from several workbooks do 
rot seem capable of revealing to students the point of the task. 
(The point of each task is in parentheses.) 

The Boy Roy (practice with the ol sound) 
Putting Down Roots (practice with root words) 
Now Hear This (a vocabulary/ picture task) 
That's not a Ship (a task with Sh and th sounds) 
The following more straightforward s§t of titles » also 
selected from several workbooks, are probably more communicative 
of their tasks* intents. 
Cause and Effect 
Alphabetical Order 
Compound Words 
Fiction and non*-fictlon 
20. English major humor should be avoided. 
This fin«il guideline Is the desperate cry of someone who has 
looked at too many workbooks. Adult humor and adult use of 
language that will pass right by most students should be 
discouraged. Perhaps tasks featuring such language are the 
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desperate attempts at cleverness of the underemployed English 
majors whom I suspect are responsible for the development of many 
workbook tasks. An overriding guideline for all Instruction 
(whether it be delivered In the written mode or in the oral mode) 
is clarity of communication. Asking second-grade students to, 
for example y "match the consonant clusters with the grape 
clusters'* or to (In a dictionary task) "Have your fingers do the 
walking" Is of questionable communicative value. 

Some Recormendations 

The evaluation procedures described In this paper should 
permit workbook evaluators to get a sense of the sufficiency and 
efficiency of the workbooks they are using or contemplate using. 
The procedure employs counting (to ascertain the number of tasks 
devoted to various topics), matching (to compare the content of 
the workbook with the content of the rest of the lesson) , and 
subjective judgment (to evaluate the usefulness and suitability 
of tasks). -.The procedure will produce data that Is partially 
"hard" and partially "soft," but that should be an improvement 
over the often used "flip" method of determining the suitability 
of workbooks. (In following the procedures, vrorkbook evaluators 
may wish to eliminate some of the guidelines and create 
additional guidelines.) 

If the examination of a set of workbooks by a group of 
workbook evaluators reveals an unacceptable number cf problems 
and weaknesses in a given workbook, then a couple of obvious 
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questions usually come to mind; "Should workbooks be Improved?'* 
and "Can workbooks be improved?" The answer to the first 
question must be "Yes/' because workbooks are relied upon so 
heavily in the teaching of reading # The answer to the second 
question could be a resounding '*Yes/' if three groups took it 
upon themselves to pay some concerted attention to workbooks. 
These three groups are: (a) educational researchers interested 
in classroom practice and curriculum design^ (b) publishe«4 of 
basal reading programs ^ and (c) teachers uf?ing the workbooks that 
are associated with basal reading programs* Some suggestions for 
each group follow: 

(a) Educational researchers > The developers of workbooks do 
have a sophisticated body of research from which to operate 



whei^ they create workbooks. Researchers have done little to 
^tudy the relationship of the content of workbooks to that of 
teachers* guides and student readers. Almost nothing has been 
written about the instructional design, the instruction giving, 
or the sequence and concentration of activities in workbooks. 
Such information would be invaluable to the developers of 
workbook tasks. But even more importantly, there is almost no 
research that makes statements about the relevance of workbook 
activities to the acquisition of reading skill. Researchers who 
are interested in the kinds of materials and activities that 
facilitated acquisition of reading skill and who are also 
interested in the design of reading programs, are urged to carry 
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out Investigations that can be applied to the development of 
workbook tasks* 

(b) Publishers of basal materials * Many of the workbooks 
associated with basal readers have the appearance of materials 
written separately from the rest of the program, and after the 
fact* So that workbooks can be a more useful part of a program, 
we urge that at the outset of the development of a new program, a 



lot of plannlng\tlme be devoted to developing plans for the 
Integration of the workbook tasks with the rest of the program* 
Mechanisms must be developed that will permit the people who 
wrliie workbook tasks to work regularly with other members of the 
writing team* 

. Another suggestion Is that materials be carefully tried out 
In small scale Intensive tryouts before being published* A 
simple and feasible procedure Is to place preliminary versions of 
workbooks In two to four classrooms* (Obviously these are 
classrooms In which Che rest of the program Is being tried out*) 
As the editors or authors observe In the classrooms, they record 
what teachers say as they present tasks, observe students as they 
do the tasks, and listen to questions students ask* By analyzing 
the completed workbook pages and tallying all the errors, 
workbook designers can Identify weak tasks (and poor Items within 
tasks) and either eliminate or remedy them* Such procedures 
woi^ld Improve workbooks enormously* 
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Finally) Instead of the current rather surface Integration 
between the textbooks, the teacher*-dlrected part of the lesson^ 
and the workbook tasks » a much deeper level of workbook and the 
rest of the lesson Integration Is suggested* Here are some 
Ideas:. 

(1) New vocabulary from the stories being read, and from 
stories previously read, can be used In a variety of 
tasks and In a variety of contexts, and nojt only In the 
tasks that are about the story. Recent work on 
vocabulary (Beck, 1982) emphasizes how many times and 
In how many different contexts words need to be 
presented for students to acquire new vocabulary* 
Workbook tasks seem an obvious medium for the 
application of this research* 

(2) Since students spend a good part of the reading period 
reading a story or an expository passage In the 
textbook. It seems only sensible that the major 
proportion of the workbook tasks should be based on 
this reading* Questions in workbook tasks that ask 
about the salient features of stories (plot, settings, 
characterizations) and about the Important Information 
In expository passages seem of more value than a steady 
diet of questions about short paragraphs unrelated to 
any other reading the students do* The application of 
the comprehension and decoding skills to the main 
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reading done In the le&son would seem to make the 
teaching (and use) of these skills much more functional 
and meaningful. Therefore , the recommendation Is that 
essentially all of the workbook tasks should relate to 
the current lesson, review aspects of previous lessons, 
or provide for the application of Information and 
vocabulary In new but related contexts, 
(c) Teachers • The advice to teachers Is for the most part 
obvious* Workbook tasks must be evaluated before being assigned 
to students. Teachers should not operate from a position of 
faith In the printed word, but rather from a position of 
skepticism. Some tasks should be abandoned because they are 
confusing^ not Important, or because they are non-productive 
consumers of time. On the other hand, tasks that are valuable 
should be repeated; particularly effective tasks can be adopted 
by the teacher to permit the students to practice further 
examples or Instances of what Is being taught.^ Teachers should 
become aware of which tasks require additional instructions, 
which pictures require modlf icauion, and which tasks most 
students can do Independently. Teachers must also realize how 
counter-productive It Is for students to spend a long time 
working on tasks on which they make many errors. Worthwhile but 
difficult, tasks should only be done when teachers have time to 
work with and monitor students as they do the tasks. 
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In addition, teachers .should make their observations about 
unsatisfactory workbooks and unsatisfactory tasks known to the 
publishers of their basal series. Publishers will change as the 
demands of their customers encourage them to change # Information 
from teachers to publishers will affect the quality of workbooks* 

Conclusion 

All of the hours students spend working In their workbooks 
have to be considered as a part of reading Instruction* What Is 
provided In those books should be given the serious consideration 
of researchers, of publishers of the materials used In 
classrooms, and of the teachers evaluating those materials* 
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Table 1 

Teaching Events and Workbook Tasks 



Program 



Level 



Unit 



Lesson 



Teacher's Guide 



Workbook 1 



Workbook 2 



Word recognition 
46 words 



1) Word meaning Items 
with 9 words from 
Lesson 10 



5)^ord meaning task 
''^ with 8 words from 
Lesson 10 



Word meaning 
22 words 

Sequencing of story 
events (6 events) 



Phonetic skills 
introduce /sp/ sp 
review /ft/ ft 



2) Sequence task with 
2 sets of 5 events 
(Independent of story 
in reader) 

3) Sentence completion 
task with 13 sp words 
(1 word from Lesson 10, 
no review words) 



Locating information 
on a contents page 

Optional 

a) Noting action and 
conversation as a 
means of characteri- 
zation 

b) Dramatizing good 
safety habits 



4) Table of contents task 



No task 



6) Sequence task with 
6 events 9 based on 
story 



7) Sentence completion 
items with 6 sp 
words (3 story 
words) 

8) and 6 ft words 
(no story words) 

9) Table of contents 
task 



No task 
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Table 2 

Number and Appropriateness of Tasks 



Program Level Unit Lesson 



Topic 


Number of 
Tasks 


Appropriate/ 
Not Appropriate 


Extra Help 
Tasks 


Appropriate/ 
Not Appropriate 


Main 
Idea 


6 


2/4 


6 


2/4 


Syllabication 


6 


3/3 


6 


3/3 


Vowels: 
ert ir» ur 


4 


0/4 


6 


4/2 


Structural 
Analysis 


8 


7/1 


10 


6/4 



ERIC 
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Table 3 
Task Topics and Task Forms 



page 


Task Topic 


page 


Task Topic 




21 


Practice with words with Ine 


36 


Syllables 




22 


Practice with oo "^^^ 


37 


Puzzles 




23 


Choosing titles 


38 


Word identification 




24 


Word Identification 


39 


Practice with words with 
ash 


25 


Using conunon syllables a, be, 
un, £ul, ly, ness 


40 


Base words and endings 


26 


Vocabulary Identification and 
use of cl, bl, pi 

Word referents 

». 


41 


Practice with words 
spr and str 


with 


27 


42 


Practice with and, 
compr e hens ion 




28 


Plural ves on words ending 
with f 


43 


Classifying words 


i 


29 


Following directions 


44 


Contractions 




30 


Alphabetical order 


45 


Sequencing 


> 


31 


Classifying words 


46 


Practice with words |with 

sw 1 


32 


Practice with words with ie 


47 


Long and short e sounds » 
comprehension \ 


33 


Compound words, comprehension 


48 


Multi-meaning words 


\ 


34 


Commas as a comprehension aid 


49 


Practice with words 
ward, comprehension 
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Noting details 


50 


Noting details 
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